2026-07-16 02:43:13,259 [ 132723 ] INFO : ClickHouse root is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse (runner:42, check_args_and_update_paths) 2026-07-16 02:43:13,259 [ 132723 ] INFO : Cases dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:86, check_args_and_update_paths) 2026-07-16 02:43:13,259 [ 132723 ] INFO : utils dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/utils (runner:97, check_args_and_update_paths) 2026-07-16 02:43:13,259 [ 132723 ] INFO : base_configs_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/programs/server, binary: /home/ubuntu/_work/_temp/test/build/clickhouse, cases_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:99, check_args_and_update_paths) clickhouse_integration_tests_volume Running pytest container as: 'docker run --rm --name clickhouse_integration_tests_63quwt --privileged --dns-search='.' --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-odbc-bridge:/clickhouse-odbc-bridge --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-library-bridge:/clickhouse-library-bridge --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=2cffe1eae894 -e DOCKER_BASE_TAG=b74d853ebe76 -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=caad4729259e -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS="--dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 test_alter_codec/test.py::test_alter_codec_index test_alter_codec/test.py::test_alter_codec_pk test_alter_comment_on_cluster/test.py::test_comment test_alter_on_mixed_type_cluster/test.py::test_alter_on_cluter_non_replicated test_alter_on_mixed_type_cluster/test.py::test_alter_replicated_on_cluster test_alter_settings_on_cluster/test.py::test_default_database_on_cluster test_analyzer_compatibility/test.py::test_two_new_versions test_async_connect_to_multiple_ips/test.py::test test_asynchronous_metric_jemalloc_profile_active/test.py::test_asynchronous_metric_jemalloc_profile_active test_azure_blob_storage_zero_copy_replication/test.py::test_zero_copy_replication test_backup_restore/test.py::test_attach_partition test_backup_restore/test.py::test_replace_partition test_backup_restore/test.py::test_restore test_backup_restore_azure_blob_storage/test.py::test_backup_restore test_backup_restore_azure_blob_storage/test.py::test_backup_restore_correct_block_ids test_backup_restore_azure_blob_storage/test.py::test_backup_restore_diff_container test_backup_restore_azure_blob_storage/test.py::test_backup_restore_on_merge_tree test_backup_restore_azure_blob_storage/test.py::test_backup_restore_with_named_collection_azure_conf1 test_backup_restore_azure_blob_storage/test.py::test_backup_restore_with_named_collection_azure_conf2 test_backup_restore_new/test.py::test_async 'test_backup_restore_new/test.py::test_async_backups_to_same_destination[http]' 'test_backup_restore_new/test.py::test_async_backups_to_same_destination[native]' 'test_backup_restore_new/test.py::test_backup_all[False]' 'test_backup_restore_new/test.py::test_backup_all[True]' 'test_backup_restore_new/test.py::test_backup_database_except[False]' 'test_backup_restore_new/test.py::test_backup_database_except[True]' test_backup_restore_new/test.py::test_backup_not_found_or_already_exists test_backup_restore_new/test.py::test_backup_partition test_backup_restore_new/test.py::test_backup_table_under_another_name test_backup_restore_new/test.py::test_backupview test_backup_restore_new/test.py::test_database test_backup_restore_new/test.py::test_dependencies test_backup_restore_new/test.py::test_empty_files_in_backup test_backup_restore_new/test.py::test_file_engine test_backup_restore_new/test.py::test_increment_backup_without_changes test_backup_restore_new/test.py::test_incremental_backup test_backup_restore_new/test.py::test_incremental_backup_after_renaming_table test_backup_restore_new/test.py::test_incremental_backup_append_table_def test_backup_restore_new/test.py::test_incremental_backup_for_log_family test_backup_restore_new/test.py::test_incremental_backup_overflow test_backup_restore_new/test.py::test_materialized_view test_backup_restore_new/test.py::test_materialized_view_select_1 test_backup_restore_new/test.py::test_materialized_view_with_target_table test_backup_restore_new/test.py::test_mutation test_backup_restore_new/test.py::test_operation_id test_backup_restore_new/test.py::test_projection test_backup_restore_new/test.py::test_required_privileges test_backup_restore_new/test.py::test_restore_all_restores_temporary_tables test_backup_restore_new/test.py::test_restore_materialized_view_with_definer test_backup_restore_new/test.py::test_restore_partition 'test_backup_restore_new/test.py::test_restore_table[Log]' 'test_backup_restore_new/test.py::test_restore_table[Memory]' 'test_backup_restore_new/test.py::test_restore_table[MergeTree]' 'test_backup_restore_new/test.py::test_restore_table[StripeLog]' 'test_backup_restore_new/test.py::test_restore_table[TinyLog]' 'test_backup_restore_new/test.py::test_restore_table_into_existing_table[Log]' 'test_backup_restore_new/test.py::test_restore_table_into_existing_table[Memory]' 'test_backup_restore_new/test.py::test_restore_table_into_existing_table[MergeTree]' 'test_backup_restore_new/test.py::test_restore_table_into_existing_table[StripeLog]' 'test_backup_restore_new/test.py::test_restore_table_into_existing_table[TinyLog]' test_backup_restore_new/test.py::test_restore_table_not_evaluate_table_defaults test_backup_restore_new/test.py::test_restore_table_under_another_name test_backup_restore_new/test.py::test_system_backups test_backup_restore_new/test.py::test_system_database test_backup_restore_new/test.py::test_system_functions test_backup_restore_new/test.py::test_system_table test_backup_restore_new/test.py::test_system_users test_backup_restore_new/test.py::test_system_users_async test_backup_restore_new/test.py::test_system_users_required_privileges test_backup_restore_new/test.py::test_tables_dependency test_backup_restore_new/test.py::test_tar_archive test_backup_restore_new/test.py::test_tar_archive_with_bad_compression_method test_backup_restore_new/test.py::test_tar_archive_with_password test_backup_restore_new/test.py::test_tar_bz2_archive test_backup_restore_new/test.py::test_tar_gz_archive test_backup_restore_new/test.py::test_tar_lzma_archive test_backup_restore_new/test.py::test_tar_xz_archive test_backup_restore_new/test.py::test_tar_zst_archive test_backup_restore_new/test.py::test_temporary_database test_backup_restore_new/test.py::test_temporary_table test_backup_restore_new/test.py::test_zip_archive test_backup_restore_new/test.py::test_zip_archive_with_bad_compression_method test_backup_restore_new/test.py::test_zip_archive_with_settings test_backup_restore_new/test_cancel_backup.py::test_cancel_backup test_backup_restore_new/test_cancel_backup.py::test_shutdown_cancel_backup test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_different_nodes test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_same_node 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Atomic-MergeTree]' 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Lazy-Log]' 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Memory-MergeTree]' 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Ordinary-MergeTree]' 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Replicated-ReplicatedMergeTree]' test_backup_restore_on_cluster/test_concurrency.py::test_kill_mutation_during_backup test_backup_restore_on_cluster/test_concurrency.py::test_replicated_table test_backward_compatibility/test_functions.py::test_aggregate_states test_backward_compatibility/test_functions.py::test_string_functions test_cluster_all_replicas/test.py::test_cluster 'test_cluster_all_replicas/test.py::test_error_on_unavailable_replica[one_shard_three_nodes]' 'test_cluster_all_replicas/test.py::test_error_on_unavailable_replica[two_shards_three_nodes]' test_cluster_all_replicas/test.py::test_global_in -vvv" altinityinfra/integration-tests-runner:cf95077f4609 '. Start tests ============================= test session starts ============================== platform linux -- Python 3.10.12, pytest-7.4.4, pluggy-1.5.0 -- /usr/bin/python3 cachedir: .pytest_cache rootdir: /ClickHouse/tests/integration configfile: pytest.ini plugins: xdist-3.5.0, order-1.0.1, random-0.2, reportlog-0.4.0, timeout-2.2.0, repeat-0.9.4 timeout: 900.0s timeout method: signal timeout func_only: False created: 10/10 workers 10 workers [100 items] scheduling tests via LoadFileScheduling test_backup_restore_azure_blob_storage/test.py::test_backup_restore test_alter_comment_on_cluster/test.py::test_comment test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_different_nodes test_cluster_all_replicas/test.py::test_cluster test_backup_restore/test.py::test_attach_partition test_backup_restore_new/test.py::test_async test_alter_codec/test.py::test_alter_codec_index test_alter_on_mixed_type_cluster/test.py::test_alter_on_cluter_non_replicated test_backup_restore_new/test_cancel_backup.py::test_cancel_backup test_backward_compatibility/test_functions.py::test_aggregate_states [gw3] [ 1%] PASSED test_cluster_all_replicas/test.py::test_cluster test_cluster_all_replicas/test.py::test_error_on_unavailable_replica[one_shard_three_nodes] [gw0] [ 2%] PASSED test_backup_restore_new/test.py::test_async [gw3] [ 3%] PASSED test_cluster_all_replicas/test.py::test_error_on_unavailable_replica[one_shard_three_nodes] test_cluster_all_replicas/test.py::test_error_on_unavailable_replica[two_shards_three_nodes] [gw3] [ 4%] PASSED test_cluster_all_replicas/test.py::test_error_on_unavailable_replica[two_shards_three_nodes] test_cluster_all_replicas/test.py::test_global_in [gw3] [ 5%] PASSED test_cluster_all_replicas/test.py::test_global_in test_backup_restore_new/test.py::test_async_backups_to_same_destination[http] [gw4] [ 6%] PASSED test_alter_codec/test.py::test_alter_codec_index test_alter_codec/test.py::test_alter_codec_pk [gw0] [ 7%] PASSED test_backup_restore_new/test.py::test_async_backups_to_same_destination[http] test_backup_restore_new/test.py::test_async_backups_to_same_destination[native] [gw4] [ 8%] PASSED test_alter_codec/test.py::test_alter_codec_pk [gw0] [ 9%] PASSED test_backup_restore_new/test.py::test_async_backups_to_same_destination[native] test_backup_restore_new/test.py::test_backup_all[False] [gw0] [ 10%] PASSED test_backup_restore_new/test.py::test_backup_all[False] test_backup_restore_new/test.py::test_backup_all[True] [gw0] [ 11%] PASSED test_backup_restore_new/test.py::test_backup_all[True] test_backup_restore_new/test.py::test_backup_database_except[False] [gw5] [ 12%] PASSED test_backup_restore/test.py::test_attach_partition test_backup_restore/test.py::test_replace_partition [gw0] [ 13%] PASSED test_backup_restore_new/test.py::test_backup_database_except[False] test_backup_restore_new/test.py::test_backup_database_except[True] [gw0] [ 14%] PASSED test_backup_restore_new/test.py::test_backup_database_except[True] test_backup_restore_new/test.py::test_backup_not_found_or_already_exists [gw0] [ 15%] PASSED test_backup_restore_new/test.py::test_backup_not_found_or_already_exists test_backup_restore_new/test.py::test_backup_partition [gw0] [ 16%] PASSED test_backup_restore_new/test.py::test_backup_partition test_backup_restore_new/test.py::test_backup_table_under_another_name [gw0] [ 17%] PASSED test_backup_restore_new/test.py::test_backup_table_under_another_name test_backup_restore_new/test.py::test_backupview [gw0] [ 18%] PASSED test_backup_restore_new/test.py::test_backupview test_backup_restore_new/test.py::test_database [gw5] [ 19%] PASSED test_backup_restore/test.py::test_replace_partition test_backup_restore/test.py::test_restore [gw0] [ 20%] PASSED test_backup_restore_new/test.py::test_database test_backup_restore_new/test.py::test_dependencies test_alter_settings_on_cluster/test.py::test_default_database_on_cluster [gw0] [ 21%] PASSED test_backup_restore_new/test.py::test_dependencies [gw9] [ 22%] PASSED test_alter_comment_on_cluster/test.py::test_comment test_backup_restore_new/test.py::test_empty_files_in_backup [gw0] [ 23%] PASSED test_backup_restore_new/test.py::test_empty_files_in_backup test_backup_restore_new/test.py::test_file_engine [gw6] [ 24%] PASSED test_alter_on_mixed_type_cluster/test.py::test_alter_on_cluter_non_replicated test_alter_on_mixed_type_cluster/test.py::test_alter_replicated_on_cluster [gw0] [ 25%] PASSED test_backup_restore_new/test.py::test_file_engine test_backup_restore_new/test.py::test_increment_backup_without_changes [gw5] [ 26%] PASSED test_backup_restore/test.py::test_restore [gw0] [ 27%] PASSED test_backup_restore_new/test.py::test_increment_backup_without_changes test_backup_restore_new/test.py::test_incremental_backup [gw6] [ 28%] PASSED test_alter_on_mixed_type_cluster/test.py::test_alter_replicated_on_cluster [gw0] [ 29%] PASSED test_backup_restore_new/test.py::test_incremental_backup test_backup_restore_new/test.py::test_incremental_backup_after_renaming_table test_azure_blob_storage_zero_copy_replication/test.py::test_zero_copy_replication [gw0] [ 30%] PASSED test_backup_restore_new/test.py::test_incremental_backup_after_renaming_table test_backup_restore_new/test.py::test_incremental_backup_append_table_def [gw0] [ 31%] PASSED test_backup_restore_new/test.py::test_incremental_backup_append_table_def test_backup_restore_new/test.py::test_incremental_backup_for_log_family [gw4] [ 32%] PASSED test_alter_settings_on_cluster/test.py::test_default_database_on_cluster [gw1] [ 33%] PASSED test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_different_nodes test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_same_node [gw0] [ 34%] PASSED test_backup_restore_new/test.py::test_incremental_backup_for_log_family test_backup_restore_new/test.py::test_incremental_backup_overflow [gw8] [ 35%] PASSED test_backward_compatibility/test_functions.py::test_aggregate_states test_backward_compatibility/test_functions.py::test_string_functions [gw1] [ 36%] PASSED test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_same_node test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Atomic-MergeTree] [gw1] [ 37%] PASSED test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Atomic-MergeTree] test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Lazy-Log] [gw7] [ 38%] PASSED test_backup_restore_new/test_cancel_backup.py::test_cancel_backup test_backup_restore_new/test_cancel_backup.py::test_shutdown_cancel_backup [gw0] [ 39%] PASSED test_backup_restore_new/test.py::test_incremental_backup_overflow test_backup_restore_new/test.py::test_materialized_view [gw0] [ 40%] PASSED test_backup_restore_new/test.py::test_materialized_view test_backup_restore_new/test.py::test_materialized_view_select_1 [gw0] [ 41%] PASSED test_backup_restore_new/test.py::test_materialized_view_select_1 test_backup_restore_new/test.py::test_materialized_view_with_target_table [gw0] [ 42%] PASSED test_backup_restore_new/test.py::test_materialized_view_with_target_table test_backup_restore_new/test.py::test_mutation [gw0] [ 43%] PASSED test_backup_restore_new/test.py::test_mutation test_backup_restore_new/test.py::test_operation_id [gw8] [ 44%] PASSED test_backward_compatibility/test_functions.py::test_string_functions [gw0] [ 45%] PASSED test_backup_restore_new/test.py::test_operation_id test_backup_restore_new/test.py::test_projection [gw0] [ 46%] PASSED test_backup_restore_new/test.py::test_projection test_backup_restore_new/test.py::test_required_privileges [gw0] [ 47%] PASSED test_backup_restore_new/test.py::test_required_privileges test_backup_restore_new/test.py::test_restore_all_restores_temporary_tables [gw0] [ 48%] PASSED test_backup_restore_new/test.py::test_restore_all_restores_temporary_tables test_backup_restore_new/test.py::test_restore_materialized_view_with_definer [gw0] [ 49%] PASSED test_backup_restore_new/test.py::test_restore_materialized_view_with_definer test_backup_restore_new/test.py::test_restore_partition [gw0] [ 50%] PASSED test_backup_restore_new/test.py::test_restore_partition test_backup_restore_new/test.py::test_restore_table[Log] [gw0] [ 51%] PASSED test_backup_restore_new/test.py::test_restore_table[Log] test_backup_restore_new/test.py::test_restore_table[Memory] [gw0] [ 52%] PASSED test_backup_restore_new/test.py::test_restore_table[Memory] test_backup_restore_new/test.py::test_restore_table[MergeTree] [gw0] [ 53%] PASSED test_backup_restore_new/test.py::test_restore_table[MergeTree] test_asynchronous_metric_jemalloc_profile_active/test.py::test_asynchronous_metric_jemalloc_profile_active test_backup_restore_new/test.py::test_restore_table[StripeLog] test_analyzer_compatibility/test.py::test_two_new_versions [gw0] [ 54%] PASSED test_backup_restore_new/test.py::test_restore_table[StripeLog] test_backup_restore_new/test.py::test_restore_table[TinyLog] [gw0] [ 55%] PASSED test_backup_restore_new/test.py::test_restore_table[TinyLog] test_backup_restore_new/test.py::test_restore_table_into_existing_table[Log] [gw2] [ 56%] PASSED test_backup_restore_azure_blob_storage/test.py::test_backup_restore test_backup_restore_azure_blob_storage/test.py::test_backup_restore_correct_block_ids [gw7] [ 57%] FAILED test_backup_restore_new/test_cancel_backup.py::test_shutdown_cancel_backup [gw0] [ 58%] PASSED test_backup_restore_new/test.py::test_restore_table_into_existing_table[Log] [gw8] [ 59%] PASSED test_asynchronous_metric_jemalloc_profile_active/test.py::test_asynchronous_metric_jemalloc_profile_active test_backup_restore_new/test.py::test_restore_table_into_existing_table[Memory] [gw0] [ 60%] PASSED test_backup_restore_new/test.py::test_restore_table_into_existing_table[Memory] test_backup_restore_new/test.py::test_restore_table_into_existing_table[MergeTree] test_async_connect_to_multiple_ips/test.py::test [gw0] [ 61%] PASSED test_backup_restore_new/test.py::test_restore_table_into_existing_table[MergeTree] test_backup_restore_new/test.py::test_restore_table_into_existing_table[StripeLog] [gw0] [ 62%] PASSED test_backup_restore_new/test.py::test_restore_table_into_existing_table[StripeLog] test_backup_restore_new/test.py::test_restore_table_into_existing_table[TinyLog] [gw0] [ 63%] PASSED test_backup_restore_new/test.py::test_restore_table_into_existing_table[TinyLog] test_backup_restore_new/test.py::test_restore_table_not_evaluate_table_defaults [gw0] [ 64%] PASSED test_backup_restore_new/test.py::test_restore_table_not_evaluate_table_defaults test_backup_restore_new/test.py::test_restore_table_under_another_name [gw0] [ 65%] PASSED test_backup_restore_new/test.py::test_restore_table_under_another_name test_backup_restore_new/test.py::test_system_backups [gw0] [ 66%] PASSED test_backup_restore_new/test.py::test_system_backups test_backup_restore_new/test.py::test_system_database [gw0] [ 67%] PASSED test_backup_restore_new/test.py::test_system_database test_backup_restore_new/test.py::test_system_functions [gw0] [ 68%] PASSED test_backup_restore_new/test.py::test_system_functions test_backup_restore_new/test.py::test_system_table [gw0] [ 69%] PASSED test_backup_restore_new/test.py::test_system_table test_backup_restore_new/test.py::test_system_users [gw0] [ 70%] PASSED test_backup_restore_new/test.py::test_system_users test_backup_restore_new/test.py::test_system_users_async [gw0] [ 71%] PASSED test_backup_restore_new/test.py::test_system_users_async test_backup_restore_new/test.py::test_system_users_required_privileges [gw0] [ 72%] PASSED test_backup_restore_new/test.py::test_system_users_required_privileges test_backup_restore_new/test.py::test_tables_dependency [gw6] [ 73%] PASSED test_analyzer_compatibility/test.py::test_two_new_versions [gw7] [ 74%] PASSED test_async_connect_to_multiple_ips/test.py::test [gw9] [ 75%] PASSED test_azure_blob_storage_zero_copy_replication/test.py::test_zero_copy_replication [gw2] [ 76%] PASSED test_backup_restore_azure_blob_storage/test.py::test_backup_restore_correct_block_ids test_backup_restore_azure_blob_storage/test.py::test_backup_restore_diff_container [gw2] [ 77%] PASSED test_backup_restore_azure_blob_storage/test.py::test_backup_restore_diff_container test_backup_restore_azure_blob_storage/test.py::test_backup_restore_on_merge_tree [gw2] [ 78%] PASSED test_backup_restore_azure_blob_storage/test.py::test_backup_restore_on_merge_tree test_backup_restore_azure_blob_storage/test.py::test_backup_restore_with_named_collection_azure_conf1 [gw2] [ 79%] PASSED test_backup_restore_azure_blob_storage/test.py::test_backup_restore_with_named_collection_azure_conf1 test_backup_restore_azure_blob_storage/test.py::test_backup_restore_with_named_collection_azure_conf2 [gw2] [ 80%] PASSED test_backup_restore_azure_blob_storage/test.py::test_backup_restore_with_named_collection_azure_conf2 [gw1] [ 81%] PASSED test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Lazy-Log] test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Memory-MergeTree] [gw0] [ 82%] PASSED test_backup_restore_new/test.py::test_tables_dependency test_backup_restore_new/test.py::test_tar_archive [gw0] [ 83%] PASSED test_backup_restore_new/test.py::test_tar_archive test_backup_restore_new/test.py::test_tar_archive_with_bad_compression_method [gw0] [ 84%] PASSED test_backup_restore_new/test.py::test_tar_archive_with_bad_compression_method test_backup_restore_new/test.py::test_tar_archive_with_password [gw0] [ 85%] PASSED test_backup_restore_new/test.py::test_tar_archive_with_password test_backup_restore_new/test.py::test_tar_bz2_archive [gw0] [ 86%] PASSED test_backup_restore_new/test.py::test_tar_bz2_archive test_backup_restore_new/test.py::test_tar_gz_archive [gw0] [ 87%] PASSED test_backup_restore_new/test.py::test_tar_gz_archive test_backup_restore_new/test.py::test_tar_lzma_archive [gw0] [ 88%] PASSED test_backup_restore_new/test.py::test_tar_lzma_archive test_backup_restore_new/test.py::test_tar_xz_archive [gw0] [ 89%] PASSED test_backup_restore_new/test.py::test_tar_xz_archive test_backup_restore_new/test.py::test_tar_zst_archive [gw0] [ 90%] PASSED test_backup_restore_new/test.py::test_tar_zst_archive test_backup_restore_new/test.py::test_temporary_database [gw0] [ 91%] PASSED test_backup_restore_new/test.py::test_temporary_database test_backup_restore_new/test.py::test_temporary_table [gw0] [ 92%] PASSED test_backup_restore_new/test.py::test_temporary_table test_backup_restore_new/test.py::test_zip_archive [gw0] [ 93%] PASSED test_backup_restore_new/test.py::test_zip_archive test_backup_restore_new/test.py::test_zip_archive_with_bad_compression_method [gw0] [ 94%] PASSED test_backup_restore_new/test.py::test_zip_archive_with_bad_compression_method test_backup_restore_new/test.py::test_zip_archive_with_settings [gw0] [ 95%] PASSED test_backup_restore_new/test.py::test_zip_archive_with_settings [gw1] [ 96%] PASSED test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Memory-MergeTree] test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Ordinary-MergeTree] [gw1] [ 97%] PASSED test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Ordinary-MergeTree] test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Replicated-ReplicatedMergeTree] [gw1] [ 98%] PASSED test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Replicated-ReplicatedMergeTree] test_backup_restore_on_cluster/test_concurrency.py::test_kill_mutation_during_backup [gw1] [ 99%] PASSED test_backup_restore_on_cluster/test_concurrency.py::test_kill_mutation_during_backup test_backup_restore_on_cluster/test_concurrency.py::test_replicated_table [gw1] [100%] PASSED test_backup_restore_on_cluster/test_concurrency.py::test_replicated_table =================================== FAILURES =================================== _________________________ test_shutdown_cancel_backup __________________________ [gw7] linux -- Python 3.10.12 /usr/bin/python3 def test_shutdown_cancel_backup(): node.query( "CREATE TABLE tbl (x UInt64) ENGINE=MergeTree() ORDER BY tuple() PARTITION BY x%5" ) node.query(f"INSERT INTO tbl SELECT number FROM numbers(500)") backup_id = uuid.uuid4().hex start_backup(backup_id) node.restart_clickhouse() # Must cancel the backup. # The information about this cancelled backup must be stored in system.backup_log > assert node.query( f"SELECT status FROM system.backup_log WHERE id='{backup_id}' ORDER BY status" ) == TSV(["CREATING_BACKUP", "BACKUP_CANCELLED"]) E assert 'CREATING_BACKUP\nBACKUP_CREATED\n' == CREATING_BACKUP\nBACKUP_CANCELLED E + where 'CREATING_BACKUP\nBACKUP_CREATED\n' = >("SELECT status FROM system.backup_log WHERE id='2c9684f46b884c759131c11eb6f67c58' ORDER BY status") E + where > = .query E + and CREATING_BACKUP\nBACKUP_CANCELLED = TSV(['CREATING_BACKUP', 'BACKUP_CANCELLED']) test_backup_restore_new/test_cancel_backup.py:221: AssertionError ----------------------------- Captured stderr call ----------------------------- Executing query CREATE TABLE tbl (x UInt64) ENGINE=MergeTree() ORDER BY tuple() PARTITION BY x%5 on node Executing query INSERT INTO tbl SELECT number FROM numbers(500) on node Executing query BACKUP TABLE tbl TO Disk('backups', '2c9684f46b884c759131c11eb6f67c58') SETTINGS id='2c9684f46b884c759131c11eb6f67c58' ASYNC on node Executing query SELECT status FROM system.backups WHERE id='2c9684f46b884c759131c11eb6f67c58' on node Executing query SELECT count() FROM system.processes WHERE query_kind='Backup' AND query LIKE '%2c9684f46b884c759131c11eb6f67c58%' on node run container_id:roottestbackuprestorenewcancelbackup_gw7_node_1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] Command:['docker', 'exec', '-u', 'root', 'roottestbackuprestorenewcancelbackup_gw7_node_1', 'bash', '-c', 'ps -C clickhouse'] Stdout: PID TTY TIME CMD Stdout: 10 ? 00:00:06 clickhouse run container_id:roottestbackuprestorenewcancelbackup_gw7_node_1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] Command:['docker', 'exec', '-u', 'root', 'roottestbackuprestorenewcancelbackup_gw7_node_1', 'bash', '-c', 'pkill clickhouse'] run container_id:roottestbackuprestorenewcancelbackup_gw7_node_1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:['docker', 'exec', 'roottestbackuprestorenewcancelbackup_gw7_node_1', 'bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Stdout:10 run container_id:roottestbackuprestorenewcancelbackup_gw7_node_1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:['docker', 'exec', 'roottestbackuprestorenewcancelbackup_gw7_node_1', 'bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Stdout:10 run container_id:roottestbackuprestorenewcancelbackup_gw7_node_1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:['docker', 'exec', 'roottestbackuprestorenewcancelbackup_gw7_node_1', 'bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestbackuprestorenewcancelbackup_gw7_node_1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:['docker', 'exec', 'roottestbackuprestorenewcancelbackup_gw7_node_1', 'bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] No clickhouse process running. Start new one. run container_id:roottestbackuprestorenewcancelbackup_gw7_node_1 detach:False nothrow:False cmd: ['bash', '-c', 'clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon'] Command:['docker', 'exec', '-u', '0', 'roottestbackuprestorenewcancelbackup_gw7_node_1', 'bash', '-c', 'clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon'] run container_id:roottestbackuprestorenewcancelbackup_gw7_node_1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:['docker', 'exec', 'roottestbackuprestorenewcancelbackup_gw7_node_1', 'bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Stdout:767 Clickhouse process running. run container_id:roottestbackuprestorenewcancelbackup_gw7_node_1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:['docker', 'exec', 'roottestbackuprestorenewcancelbackup_gw7_node_1', 'bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Stdout:767 Executing query select 20 on node Executing query SELECT status FROM system.backup_log WHERE id='2c9684f46b884c759131c11eb6f67c58' ORDER BY status on node ------------------------------ Captured log call ------------------------------- 2026-07-16 02:45:22 [ 581 ] DEBUG : Executing query CREATE TABLE tbl (x UInt64) ENGINE=MergeTree() ORDER BY tuple() PARTITION BY x%5 on node (cluster.py:3606, query) 2026-07-16 02:45:22 [ 581 ] DEBUG : Executing query INSERT INTO tbl SELECT number FROM numbers(500) on node (cluster.py:3606, query) 2026-07-16 02:45:23 [ 581 ] DEBUG : Executing query BACKUP TABLE tbl TO Disk('backups', '2c9684f46b884c759131c11eb6f67c58') SETTINGS id='2c9684f46b884c759131c11eb6f67c58' ASYNC on node (cluster.py:3606, query) 2026-07-16 02:45:23 [ 581 ] DEBUG : Executing query SELECT status FROM system.backups WHERE id='2c9684f46b884c759131c11eb6f67c58' on node (cluster.py:3606, query) 2026-07-16 02:45:23 [ 581 ] DEBUG : Executing query SELECT count() FROM system.processes WHERE query_kind='Backup' AND query LIKE '%2c9684f46b884c759131c11eb6f67c58%' on node (cluster.py:3606, query) 2026-07-16 02:45:23 [ 581 ] DEBUG : run container_id:roottestbackuprestorenewcancelbackup_gw7_node_1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] (cluster.py:2175, exec_in_container) 2026-07-16 02:45:23 [ 581 ] DEBUG : Command:['docker', 'exec', '-u', 'root', 'roottestbackuprestorenewcancelbackup_gw7_node_1', 'bash', '-c', 'ps -C clickhouse'] (cluster.py:113, run_and_check) 2026-07-16 02:45:59 [ 581 ] DEBUG : Stdout: PID TTY TIME CMD (cluster.py:121, run_and_check) 2026-07-16 02:45:59 [ 581 ] DEBUG : Stdout: 10 ? 00:00:06 clickhouse (cluster.py:121, run_and_check) 2026-07-16 02:45:59 [ 581 ] DEBUG : run container_id:roottestbackuprestorenewcancelbackup_gw7_node_1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] (cluster.py:2175, exec_in_container) 2026-07-16 02:45:59 [ 581 ] DEBUG : Command:['docker', 'exec', '-u', 'root', 'roottestbackuprestorenewcancelbackup_gw7_node_1', 'bash', '-c', 'pkill clickhouse'] (cluster.py:113, run_and_check) 2026-07-16 02:45:59 [ 581 ] DEBUG : run container_id:roottestbackuprestorenewcancelbackup_gw7_node_1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2175, exec_in_container) 2026-07-16 02:45:59 [ 581 ] DEBUG : Command:['docker', 'exec', 'roottestbackuprestorenewcancelbackup_gw7_node_1', 'bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:113, run_and_check) 2026-07-16 02:45:59 [ 581 ] DEBUG : Stdout:10 (cluster.py:121, run_and_check) 2026-07-16 02:46:00 [ 581 ] DEBUG : run container_id:roottestbackuprestorenewcancelbackup_gw7_node_1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2175, exec_in_container) 2026-07-16 02:46:00 [ 581 ] DEBUG : Command:['docker', 'exec', 'roottestbackuprestorenewcancelbackup_gw7_node_1', 'bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:113, run_and_check) 2026-07-16 02:46:00 [ 581 ] DEBUG : Stdout:10 (cluster.py:121, run_and_check) 2026-07-16 02:46:01 [ 581 ] DEBUG : run container_id:roottestbackuprestorenewcancelbackup_gw7_node_1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2175, exec_in_container) 2026-07-16 02:46:01 [ 581 ] DEBUG : Command:['docker', 'exec', 'roottestbackuprestorenewcancelbackup_gw7_node_1', 'bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:113, run_and_check) 2026-07-16 02:46:01 [ 581 ] DEBUG : run container_id:roottestbackuprestorenewcancelbackup_gw7_node_1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2175, exec_in_container) 2026-07-16 02:46:01 [ 581 ] DEBUG : Command:['docker', 'exec', 'roottestbackuprestorenewcancelbackup_gw7_node_1', 'bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:113, run_and_check) 2026-07-16 02:46:01 [ 581 ] DEBUG : No clickhouse process running. Start new one. (cluster.py:3968, start_clickhouse) 2026-07-16 02:46:01 [ 581 ] DEBUG : run container_id:roottestbackuprestorenewcancelbackup_gw7_node_1 detach:False nothrow:False cmd: ['bash', '-c', 'clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon'] (cluster.py:2175, exec_in_container) 2026-07-16 02:46:01 [ 581 ] DEBUG : Command:['docker', 'exec', '-u', '0', 'roottestbackuprestorenewcancelbackup_gw7_node_1', 'bash', '-c', 'clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon'] (cluster.py:113, run_and_check) 2026-07-16 02:46:02 [ 581 ] DEBUG : run container_id:roottestbackuprestorenewcancelbackup_gw7_node_1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2175, exec_in_container) 2026-07-16 02:46:02 [ 581 ] DEBUG : Command:['docker', 'exec', 'roottestbackuprestorenewcancelbackup_gw7_node_1', 'bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:113, run_and_check) 2026-07-16 02:46:02 [ 581 ] DEBUG : Stdout:767 (cluster.py:121, run_and_check) 2026-07-16 02:46:02 [ 581 ] DEBUG : Clickhouse process running. (cluster.py:3979, start_clickhouse) 2026-07-16 02:46:02 [ 581 ] DEBUG : run container_id:roottestbackuprestorenewcancelbackup_gw7_node_1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2175, exec_in_container) 2026-07-16 02:46:02 [ 581 ] DEBUG : Command:['docker', 'exec', 'roottestbackuprestorenewcancelbackup_gw7_node_1', 'bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:113, run_and_check) 2026-07-16 02:46:02 [ 581 ] DEBUG : Stdout:767 (cluster.py:121, run_and_check) 2026-07-16 02:46:02 [ 581 ] DEBUG : Executing query select 20 on node (cluster.py:3606, query) 2026-07-16 02:46:02 [ 581 ] DEBUG : Executing query SELECT status FROM system.backup_log WHERE id='2c9684f46b884c759131c11eb6f67c58' ORDER BY status on node (cluster.py:3606, query) --------------------------- Captured stderr teardown --------------------------- Executing query DROP TABLE IF EXISTS tbl SYNC on node Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_new/_instances_cancel_backup_0_gw7/.env', '--project-name', 'roottestbackuprestorenewcancelbackup_gw7', '--file', '/ClickHouse/tests/integration/test_backup_restore_new/_instances_cancel_backup_0_gw7/node/docker-compose.yml', 'stop', '--timeout', '20'] Stderr:Stopping roottestbackuprestorenewcancelbackup_gw7_node_1 ... Stderr:Stopping roottestbackuprestorenewcancelbackup_gw7_node_1 ... done Command:['bash', '-c', '[ -f /ClickHouse/tests/integration/test_backup_restore_new/_instances_cancel_backup_0_gw7/node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_backup_restore_new/_instances_cancel_backup_0_gw7/node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true'] Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_new/_instances_cancel_backup_0_gw7/.env', '--project-name', 'roottestbackuprestorenewcancelbackup_gw7', '--file', '/ClickHouse/tests/integration/test_backup_restore_new/_instances_cancel_backup_0_gw7/node/docker-compose.yml', 'down', '--volumes'] Stderr:Removing roottestbackuprestorenewcancelbackup_gw7_node_1 ... Stderr:Removing roottestbackuprestorenewcancelbackup_gw7_node_1 ... done Stderr:Removing network roottestbackuprestorenewcancelbackup_gw7_default Cleanup called Docker networks for project roottestbackuprestorenewcancelbackup_gw7 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestbackuprestorenewcancelbackup_gw7 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestbackuprestorenewcancelbackup_gw7 are DRIVER VOLUME NAME Command:docker container list --all --filter name='^/roottestbackuprestorenewcancelbackup_gw7_.*_1$' --format '{{.ID}}:{{.Names}}' Unstopped containers: {} No running containers for project: roottestbackuprestorenewcancelbackup_gw7 Trying to prune unused networks... Trying to prune unused volumes... Command:['docker volume ls | wc -l'] Stdout:5 ---------------------------- Captured log teardown ----------------------------- 2026-07-16 02:46:02 [ 581 ] DEBUG : Executing query DROP TABLE IF EXISTS tbl SYNC on node (cluster.py:3606, query) 2026-07-16 02:46:03 [ 581 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_new/_instances_cancel_backup_0_gw7/.env', '--project-name', 'roottestbackuprestorenewcancelbackup_gw7', '--file', '/ClickHouse/tests/integration/test_backup_restore_new/_instances_cancel_backup_0_gw7/node/docker-compose.yml', 'stop', '--timeout', '20'] (cluster.py:113, run_and_check) 2026-07-16 02:46:04 [ 581 ] DEBUG : Stderr:Stopping roottestbackuprestorenewcancelbackup_gw7_node_1 ... (cluster.py:123, run_and_check) 2026-07-16 02:46:04 [ 581 ] DEBUG : Stderr:Stopping roottestbackuprestorenewcancelbackup_gw7_node_1 ... done (cluster.py:123, run_and_check) 2026-07-16 02:46:04 [ 581 ] DEBUG : Command:['bash', '-c', '[ -f /ClickHouse/tests/integration/test_backup_restore_new/_instances_cancel_backup_0_gw7/node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_backup_restore_new/_instances_cancel_backup_0_gw7/node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true'] (cluster.py:113, run_and_check) 2026-07-16 02:46:04 [ 581 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_new/_instances_cancel_backup_0_gw7/.env', '--project-name', 'roottestbackuprestorenewcancelbackup_gw7', '--file', '/ClickHouse/tests/integration/test_backup_restore_new/_instances_cancel_backup_0_gw7/node/docker-compose.yml', 'down', '--volumes'] (cluster.py:113, run_and_check) 2026-07-16 02:46:04 [ 581 ] DEBUG : Stderr:Removing roottestbackuprestorenewcancelbackup_gw7_node_1 ... (cluster.py:123, run_and_check) 2026-07-16 02:46:04 [ 581 ] DEBUG : Stderr:Removing roottestbackuprestorenewcancelbackup_gw7_node_1 ... done (cluster.py:123, run_and_check) 2026-07-16 02:46:04 [ 581 ] DEBUG : Stderr:Removing network roottestbackuprestorenewcancelbackup_gw7_default (cluster.py:123, run_and_check) 2026-07-16 02:46:04 [ 581 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-07-16 02:46:04 [ 581 ] DEBUG : Docker networks for project roottestbackuprestorenewcancelbackup_gw7 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-07-16 02:46:04 [ 581 ] DEBUG : Docker containers for project roottestbackuprestorenewcancelbackup_gw7 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-07-16 02:46:04 [ 581 ] DEBUG : Docker volumes for project roottestbackuprestorenewcancelbackup_gw7 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-07-16 02:46:04 [ 581 ] DEBUG : Command:docker container list --all --filter name='^/roottestbackuprestorenewcancelbackup_gw7_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-07-16 02:46:04 [ 581 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-07-16 02:46:04 [ 581 ] DEBUG : No running containers for project: roottestbackuprestorenewcancelbackup_gw7 (cluster.py:904, cleanup) 2026-07-16 02:46:04 [ 581 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-07-16 02:46:04 [ 581 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-07-16 02:46:04 [ 581 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-07-16 02:46:04 [ 581 ] DEBUG : Stdout:5 (cluster.py:121, run_and_check) ============================== slowest durations =============================== 163.07s setup test_backup_restore_azure_blob_storage/test.py::test_backup_restore 159.34s setup test_azure_blob_storage_zero_copy_replication/test.py::test_zero_copy_replication 141.41s teardown test_alter_on_mixed_type_cluster/test.py::test_alter_replicated_on_cluster 137.98s teardown test_alter_settings_on_cluster/test.py::test_default_database_on_cluster 122.47s call test_backup_restore_new/test_cancel_backup.py::test_cancel_backup 114.96s call test_backward_compatibility/test_functions.py::test_string_functions 105.15s call test_backup_restore_new/test.py::test_incremental_backup_overflow 86.74s call test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Atomic-MergeTree] 78.20s call test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Replicated-ReplicatedMergeTree] 75.46s call test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Lazy-Log] 74.26s call test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Ordinary-MergeTree] 73.89s call test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Memory-MergeTree] 42.13s call test_backup_restore_new/test.py::test_tables_dependency 40.04s call test_backup_restore_new/test_cancel_backup.py::test_shutdown_cancel_backup 24.14s call test_backup_restore_azure_blob_storage/test.py::test_backup_restore_correct_block_ids 20.14s setup test_analyzer_compatibility/test.py::test_two_new_versions 18.46s teardown test_backward_compatibility/test_functions.py::test_string_functions 18.18s setup test_alter_on_mixed_type_cluster/test.py::test_alter_on_cluter_non_replicated 18.02s setup test_backward_compatibility/test_functions.py::test_aggregate_states 17.95s setup test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_different_nodes 16.97s setup test_alter_comment_on_cluster/test.py::test_comment 15.54s setup test_async_connect_to_multiple_ips/test.py::test 13.13s teardown test_azure_blob_storage_zero_copy_replication/test.py::test_zero_copy_replication 12.84s teardown test_cluster_all_replicas/test.py::test_global_in 11.51s call test_backward_compatibility/test_functions.py::test_aggregate_states 11.32s teardown test_alter_codec/test.py::test_alter_codec_pk 10.55s teardown test_backup_restore_on_cluster/test_concurrency.py::test_replicated_table 8.05s setup test_alter_settings_on_cluster/test.py::test_default_database_on_cluster 7.84s call test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_different_nodes 7.65s teardown test_analyzer_compatibility/test.py::test_two_new_versions 7.49s call test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_same_node 7.43s call test_backup_restore/test.py::test_replace_partition 5.63s teardown test_alter_comment_on_cluster/test.py::test_comment 5.57s teardown test_asynchronous_metric_jemalloc_profile_active/test.py::test_asynchronous_metric_jemalloc_profile_active 5.49s teardown test_async_connect_to_multiple_ips/test.py::test 5.07s call test_backup_restore/test.py::test_attach_partition 4.91s teardown test_backup_restore_azure_blob_storage/test.py::test_backup_restore_with_named_collection_azure_conf2 4.67s call test_backup_restore/test.py::test_restore 4.66s teardown test_backup_restore_new/test.py::test_zip_archive_with_settings 4.62s call test_backup_restore_new/test.py::test_mutation 4.36s call test_azure_blob_storage_zero_copy_replication/test.py::test_zero_copy_replication 4.33s call test_backup_restore_on_cluster/test_concurrency.py::test_kill_mutation_during_backup 4.26s teardown test_backup_restore/test.py::test_restore 3.72s setup test_backup_restore/test.py::test_attach_partition 3.61s call test_async_connect_to_multiple_ips/test.py::test 3.41s setup test_cluster_all_replicas/test.py::test_cluster 3.41s setup test_alter_codec/test.py::test_alter_codec_index 3.35s call test_backup_restore_new/test.py::test_system_users 2.96s setup test_backup_restore_new/test_cancel_backup.py::test_cancel_backup 2.94s setup test_backup_restore_new/test.py::test_async 2.59s call test_backup_restore_new/test.py::test_materialized_view 2.44s setup test_asynchronous_metric_jemalloc_profile_active/test.py::test_asynchronous_metric_jemalloc_profile_active 2.41s call test_backup_restore_azure_blob_storage/test.py::test_backup_restore 2.18s call test_backup_restore_azure_blob_storage/test.py::test_backup_restore_on_merge_tree 2.11s call test_alter_on_mixed_type_cluster/test.py::test_alter_on_cluter_non_replicated 2.08s call test_backup_restore_new/test.py::test_required_privileges 2.08s call test_backup_restore_new/test.py::test_restore_table[Memory] 2.07s call test_backup_restore_on_cluster/test_concurrency.py::test_replicated_table 2.04s teardown test_backup_restore_new/test_cancel_backup.py::test_shutdown_cancel_backup 1.84s call test_backup_restore_new/test.py::test_restore_table[Log] 1.82s call test_backup_restore_new/test.py::test_operation_id 1.77s call test_alter_on_mixed_type_cluster/test.py::test_alter_replicated_on_cluster 1.63s call test_backup_restore_new/test.py::test_materialized_view_with_target_table 1.60s call test_backup_restore_new/test.py::test_restore_materialized_view_with_definer 1.59s call test_backup_restore_new/test.py::test_backup_table_under_another_name 1.49s call test_analyzer_compatibility/test.py::test_two_new_versions 1.47s call test_backup_restore_new/test.py::test_projection 1.37s call test_backup_restore_new/test.py::test_restore_partition 1.33s call test_backup_restore_new/test.py::test_dependencies 1.30s call test_backup_restore_new/test.py::test_restore_table_not_evaluate_table_defaults 1.26s call test_backup_restore_new/test.py::test_system_users_required_privileges 1.22s call test_backup_restore_new/test.py::test_system_functions 1.22s call test_alter_comment_on_cluster/test.py::test_comment 1.06s call test_alter_codec/test.py::test_alter_codec_pk 1.02s call test_alter_codec/test.py::test_alter_codec_index 1.02s call test_backup_restore_azure_blob_storage/test.py::test_backup_restore_with_named_collection_azure_conf1 1.01s call test_backup_restore_new/test.py::test_restore_table[MergeTree] 1.01s call test_backup_restore_azure_blob_storage/test.py::test_backup_restore_with_named_collection_azure_conf2 0.99s call test_backup_restore_new/test.py::test_backup_all[True] 0.93s call test_backup_restore_azure_blob_storage/test.py::test_backup_restore_diff_container 0.90s call test_backup_restore_new/test.py::test_backup_all[False] 0.90s call test_backup_restore_new/test.py::test_materialized_view_select_1 0.88s call test_backup_restore_new/test.py::test_zip_archive_with_settings 0.86s call test_backup_restore_new/test.py::test_restore_table_into_existing_table[TinyLog] 0.85s call test_alter_settings_on_cluster/test.py::test_default_database_on_cluster 0.82s call test_backup_restore_new/test.py::test_backup_partition 0.82s teardown test_backup_restore_new/test.py::test_system_table 0.81s call test_backup_restore_new/test.py::test_backup_database_except[False] 0.78s call test_backup_restore_new/test.py::test_async 0.78s call test_backup_restore_new/test.py::test_incremental_backup_append_table_def 0.77s call test_backup_restore_new/test.py::test_incremental_backup_for_log_family 0.77s call test_backup_restore_new/test.py::test_restore_table_into_existing_table[Memory] 0.75s call test_backup_restore_new/test.py::test_incremental_backup 0.73s teardown test_backup_restore_new/test.py::test_system_users 0.73s call test_backup_restore_new/test.py::test_async_backups_to_same_destination[native] 0.73s teardown test_backup_restore_new/test.py::test_system_functions 0.72s teardown test_backup_restore_new/test.py::test_restore_table_into_existing_table[TinyLog] 0.72s call test_backup_restore_new/test.py::test_increment_backup_without_changes 0.71s teardown test_backup_restore_new/test.py::test_restore_table[MergeTree] 0.71s teardown test_backup_restore_new/test.py::test_operation_id 0.71s call test_backup_restore_new/test.py::test_async_backups_to_same_destination[http] 0.71s call test_backup_restore_new/test.py::test_restore_table_into_existing_table[Log] 0.70s call test_backup_restore_new/test.py::test_restore_table_into_existing_table[MergeTree] 0.67s call test_backup_restore_new/test.py::test_backup_not_found_or_already_exists 0.66s teardown test_backup_restore_new/test.py::test_backup_table_under_another_name 0.65s call test_backup_restore_new/test.py::test_incremental_backup_after_renaming_table 0.65s call test_backup_restore_new/test.py::test_tar_lzma_archive 0.65s call test_backup_restore_new/test.py::test_tar_xz_archive 0.65s call test_backup_restore_new/test.py::test_tar_bz2_archive 0.65s call test_backup_restore_new/test.py::test_restore_table_into_existing_table[StripeLog] 0.65s teardown test_backup_restore_new/test.py::test_restore_table[Memory] 0.65s call test_backup_restore_new/test.py::test_backup_database_except[True] 0.63s call test_backup_restore_new/test.py::test_file_engine 0.62s teardown test_backup_restore_new/test.py::test_required_privileges 0.62s call test_backup_restore_new/test.py::test_system_backups 0.62s call test_backup_restore_new/test.py::test_empty_files_in_backup 0.61s call test_backup_restore_new/test.py::test_tar_archive 0.60s teardown test_backup_restore_new/test.py::test_projection 0.60s teardown test_backup_restore_new/test.py::test_incremental_backup 0.59s teardown test_backup_restore_new/test.py::test_incremental_backup_overflow 0.59s call test_backup_restore_new/test.py::test_restore_table[TinyLog] 0.58s teardown test_backup_restore_new/test.py::test_restore_all_restores_temporary_tables 0.58s call test_backup_restore_new/test.py::test_tar_gz_archive 0.58s call test_backup_restore_new/test.py::test_zip_archive 0.57s teardown test_backup_restore_new/test.py::test_materialized_view_with_target_table 0.57s teardown test_backup_restore_new/test.py::test_materialized_view 0.56s call test_backup_restore_new/test.py::test_restore_table[StripeLog] 0.55s call test_backup_restore_new/test.py::test_tar_zst_archive 0.54s teardown test_backup_restore_new/test.py::test_restore_materialized_view_with_definer 0.53s teardown test_backup_restore_new/test.py::test_restore_partition 0.52s call test_backup_restore_new/test.py::test_restore_table_under_another_name 0.51s teardown test_backup_restore_new/test.py::test_restore_table_into_existing_table[Memory] 0.50s teardown test_backup_restore_new/test.py::test_materialized_view_select_1 0.50s call test_backup_restore_new/test.py::test_database 0.49s call test_asynchronous_metric_jemalloc_profile_active/test.py::test_asynchronous_metric_jemalloc_profile_active 0.48s teardown test_backup_restore_new/test.py::test_empty_files_in_backup 0.47s teardown test_backup_restore_new/test.py::test_mutation 0.47s teardown test_backup_restore_new/test.py::test_dependencies 0.46s teardown test_backup_restore_new/test.py::test_database 0.46s teardown test_backup_restore_new/test.py::test_system_users_async 0.45s teardown test_backup_restore_new/test.py::test_restore_table[Log] 0.45s call test_backup_restore_new/test.py::test_system_users_async 0.43s teardown test_backup_restore_new/test.py::test_incremental_backup_after_renaming_table 0.43s teardown test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Replicated-ReplicatedMergeTree] 0.43s teardown test_backup_restore_new/test.py::test_file_engine 0.42s teardown test_backup_restore_new/test.py::test_restore_table_not_evaluate_table_defaults 0.41s teardown test_backup_restore_new/test.py::test_restore_table_into_existing_table[Log] 0.40s teardown test_backup_restore_new/test.py::test_restore_table[StripeLog] 0.40s teardown test_backup_restore_new/test.py::test_increment_backup_without_changes 0.40s teardown test_backup_restore_new/test.py::test_restore_table[TinyLog] 0.39s teardown test_backup_restore_new/test.py::test_incremental_backup_append_table_def 0.39s teardown test_backup_restore_new/test.py::test_tar_lzma_archive 0.39s teardown test_backup_restore_new/test.py::test_system_backups 0.39s call test_backup_restore_new/test.py::test_tar_archive_with_bad_compression_method 0.39s call test_backup_restore_new/test.py::test_zip_archive_with_bad_compression_method 0.38s teardown test_backup_restore_new/test.py::test_async 0.38s teardown test_backup_restore_new/test.py::test_backupview 0.36s teardown test_backup_restore_new/test.py::test_incremental_backup_for_log_family 0.36s teardown test_backup_restore_new/test.py::test_restore_table_into_existing_table[StripeLog] 0.36s teardown test_backup_restore_new/test.py::test_restore_table_into_existing_table[MergeTree] 0.36s teardown test_backup_restore_new/test.py::test_system_database 0.36s teardown test_backup_restore_new/test.py::test_tar_archive 0.36s teardown test_backup_restore_new/test.py::test_temporary_table 0.36s call test_backup_restore_new/test.py::test_tar_archive_with_password 0.35s teardown test_backup_restore_new/test.py::test_backup_not_found_or_already_exists 0.34s teardown test_backup_restore_new/test.py::test_backup_partition 0.33s teardown test_backup_restore_new/test.py::test_backup_all[False] 0.33s teardown test_backup_restore_new/test.py::test_backup_all[True] 0.32s teardown test_backup_restore_new/test.py::test_zip_archive_with_bad_compression_method 0.32s teardown test_backup_restore_new/test.py::test_backup_database_except[True] 0.32s teardown test_backup_restore_new/test.py::test_tar_archive_with_bad_compression_method 0.32s teardown test_backup_restore_new/test.py::test_zip_archive 0.32s teardown test_backup_restore_new/test.py::test_tar_xz_archive 0.32s teardown test_backup_restore_new/test.py::test_tar_archive_with_password 0.31s call test_backup_restore_new/test.py::test_backupview 0.30s teardown test_backup_restore_new/test.py::test_tables_dependency 0.29s teardown test_backup_restore_new/test.py::test_async_backups_to_same_destination[native] 0.29s teardown test_backup_restore_new/test.py::test_tar_gz_archive 0.29s teardown test_backup_restore_new/test.py::test_restore_table_under_another_name 0.29s teardown test_backup_restore_new/test.py::test_temporary_database 0.27s call test_cluster_all_replicas/test.py::test_cluster 0.26s teardown test_backup_restore_new/test.py::test_system_users_required_privileges 0.26s teardown test_backup_restore_new/test.py::test_async_backups_to_same_destination[http] 0.26s teardown test_backup_restore_new/test.py::test_backup_database_except[False] 0.26s teardown test_backup_restore_new/test.py::test_tar_bz2_archive 0.26s teardown test_backup_restore_new/test.py::test_tar_zst_archive 0.24s call test_cluster_all_replicas/test.py::test_global_in 0.23s teardown test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Ordinary-MergeTree] 0.23s teardown test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Memory-MergeTree] 0.23s teardown test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Lazy-Log] 0.23s teardown test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Atomic-MergeTree] 0.23s teardown test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_different_nodes 0.23s call test_backup_restore_new/test.py::test_system_table 0.23s teardown test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_same_node 0.23s teardown test_backup_restore_on_cluster/test_concurrency.py::test_kill_mutation_during_backup 0.17s call test_backup_restore_new/test.py::test_system_database 0.15s call test_backup_restore_new/test.py::test_restore_all_restores_temporary_tables 0.08s teardown test_backup_restore_new/test_cancel_backup.py::test_cancel_backup 0.07s call test_cluster_all_replicas/test.py::test_error_on_unavailable_replica[one_shard_three_nodes] 0.07s call test_cluster_all_replicas/test.py::test_error_on_unavailable_replica[two_shards_three_nodes] 0.02s call test_backup_restore_new/test.py::test_temporary_table 0.01s call test_backup_restore_new/test.py::test_temporary_database 0.01s setup test_backup_restore_new/test.py::test_restore_table[MergeTree] 0.00s teardown test_backup_restore_azure_blob_storage/test.py::test_backup_restore_on_merge_tree 0.00s setup test_backup_restore_new/test.py::test_backup_all[True] 0.00s setup test_backup_restore_azure_blob_storage/test.py::test_backup_restore_with_named_collection_azure_conf1 0.00s setup test_cluster_all_replicas/test.py::test_error_on_unavailable_replica[two_shards_three_nodes] 0.00s setup test_backup_restore_new/test.py::test_dependencies 0.00s setup test_backup_restore_new/test.py::test_file_engine 0.00s setup test_backup_restore_new/test.py::test_restore_table[StripeLog] 0.00s setup test_cluster_all_replicas/test.py::test_error_on_unavailable_replica[one_shard_three_nodes] 0.00s setup test_backup_restore_new/test.py::test_restore_table_not_evaluate_table_defaults 0.00s setup test_backup_restore_new/test.py::test_empty_files_in_backup 0.00s setup test_backup_restore_new/test.py::test_tar_archive 0.00s setup test_backup_restore_new/test.py::test_restore_table_into_existing_table[Log] 0.00s setup test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Ordinary-MergeTree] 0.00s setup test_backup_restore_new/test.py::test_restore_table_into_existing_table[Memory] 0.00s setup test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Memory-MergeTree] 0.00s setup test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Replicated-ReplicatedMergeTree] 0.00s setup test_backup_restore_new/test.py::test_incremental_backup_overflow 0.00s setup test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Lazy-Log] 0.00s setup test_backup_restore_new/test.py::test_backup_database_except[True] 0.00s setup test_backup_restore_new/test.py::test_restore_table_into_existing_table[MergeTree] 0.00s setup test_backup_restore_new/test.py::test_backup_all[False] 0.00s setup test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Atomic-MergeTree] 0.00s setup test_backup_restore_new/test.py::test_system_users_required_privileges 0.00s setup test_backup_restore_new/test.py::test_restore_table_under_another_name 0.00s setup test_backup_restore_new/test.py::test_increment_backup_without_changes 0.00s setup test_backup_restore_new/test.py::test_restore_table[Log] 0.00s setup test_backup_restore_new/test.py::test_restore_table_into_existing_table[TinyLog] 0.00s setup test_backup_restore_new/test.py::test_restore_table[TinyLog] 0.00s setup test_backup_restore_on_cluster/test_concurrency.py::test_kill_mutation_during_backup 0.00s setup test_backup_restore_new/test.py::test_async_backups_to_same_destination[http] 0.00s setup test_backup_restore_new/test.py::test_restore_table[Memory] 0.00s setup test_backup_restore_on_cluster/test_concurrency.py::test_replicated_table 0.00s setup test_backup_restore_new/test.py::test_operation_id 0.00s setup test_backup_restore_new/test.py::test_restore_table_into_existing_table[StripeLog] 0.00s setup test_backup_restore_new/test.py::test_system_backups 0.00s setup test_backup_restore_new/test.py::test_tar_xz_archive 0.00s setup test_backup_restore_new/test.py::test_async_backups_to_same_destination[native] 0.00s setup test_backup_restore_new/test.py::test_tar_lzma_archive 0.00s setup test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_same_node 0.00s setup test_backup_restore_new/test.py::test_restore_all_restores_temporary_tables 0.00s setup test_backup_restore_new/test.py::test_system_table 0.00s setup test_backup_restore_new/test.py::test_materialized_view_with_target_table 0.00s setup test_backup_restore_new/test.py::test_tar_bz2_archive 0.00s setup test_backup_restore_new/test.py::test_backupview 0.00s setup test_backup_restore_azure_blob_storage/test.py::test_backup_restore_correct_block_ids 0.00s setup test_backup_restore_new/test.py::test_backup_database_except[False] 0.00s setup test_backup_restore/test.py::test_restore 0.00s setup test_backup_restore_new/test.py::test_restore_materialized_view_with_definer 0.00s setup test_backup_restore_new/test.py::test_temporary_database 0.00s setup test_backup_restore_new/test.py::test_materialized_view_select_1 0.00s setup test_backup_restore_new/test.py::test_materialized_view 0.00s setup test_backup_restore_new/test.py::test_incremental_backup_append_table_def 0.00s setup test_backup_restore_new/test.py::test_incremental_backup_for_log_family 0.00s setup test_backup_restore_new/test.py::test_backup_table_under_another_name 0.00s setup test_backup_restore_new/test.py::test_database 0.00s setup test_backup_restore_new/test.py::test_required_privileges 0.00s setup test_backup_restore_new/test.py::test_zip_archive_with_bad_compression_method 0.00s setup test_backup_restore_new/test.py::test_mutation 0.00s setup test_backup_restore_new/test.py::test_incremental_backup 0.00s setup test_backup_restore_new/test_cancel_backup.py::test_shutdown_cancel_backup 0.00s setup test_backup_restore_new/test.py::test_temporary_table 0.00s setup test_backup_restore_new/test.py::test_tar_gz_archive 0.00s setup test_backup_restore_new/test.py::test_restore_partition 0.00s setup test_backup_restore_new/test.py::test_system_functions 0.00s teardown test_backup_restore_azure_blob_storage/test.py::test_backup_restore 0.00s setup test_backup_restore_new/test.py::test_tables_dependency 0.00s setup test_backup_restore_new/test.py::test_zip_archive_with_settings 0.00s setup test_backup_restore_new/test.py::test_backup_partition 0.00s setup test_backup_restore_new/test.py::test_system_users 0.00s setup test_backup_restore_new/test.py::test_tar_archive_with_password 0.00s setup test_backup_restore_new/test.py::test_system_database 0.00s teardown test_backward_compatibility/test_functions.py::test_aggregate_states 0.00s teardown test_alter_on_mixed_type_cluster/test.py::test_alter_on_cluter_non_replicated 0.00s setup test_backup_restore_new/test.py::test_system_users_async 0.00s setup test_backup_restore_new/test.py::test_incremental_backup_after_renaming_table 0.00s setup test_backup_restore_new/test.py::test_zip_archive 0.00s setup test_backup_restore_new/test.py::test_tar_zst_archive 0.00s setup test_backup_restore_new/test.py::test_tar_archive_with_bad_compression_method 0.00s setup test_backup_restore_new/test.py::test_backup_not_found_or_already_exists 0.00s setup test_backup_restore_new/test.py::test_projection 0.00s setup test_backward_compatibility/test_functions.py::test_string_functions 0.00s setup test_cluster_all_replicas/test.py::test_global_in 0.00s setup test_backup_restore/test.py::test_replace_partition 0.00s teardown test_cluster_all_replicas/test.py::test_cluster 0.00s setup test_alter_codec/test.py::test_alter_codec_pk 0.00s setup test_backup_restore_azure_blob_storage/test.py::test_backup_restore_on_merge_tree 0.00s setup test_backup_restore_azure_blob_storage/test.py::test_backup_restore_diff_container 0.00s teardown test_cluster_all_replicas/test.py::test_error_on_unavailable_replica[one_shard_three_nodes] 0.00s setup test_backup_restore_azure_blob_storage/test.py::test_backup_restore_with_named_collection_azure_conf2 0.00s teardown test_backup_restore/test.py::test_attach_partition 0.00s setup test_alter_on_mixed_type_cluster/test.py::test_alter_replicated_on_cluster 0.00s teardown test_cluster_all_replicas/test.py::test_error_on_unavailable_replica[two_shards_three_nodes] 0.00s teardown test_alter_codec/test.py::test_alter_codec_index 0.00s teardown test_backup_restore_azure_blob_storage/test.py::test_backup_restore_correct_block_ids 0.00s teardown test_backup_restore/test.py::test_replace_partition 0.00s teardown test_backup_restore_azure_blob_storage/test.py::test_backup_restore_with_named_collection_azure_conf1 0.00s teardown test_backup_restore_azure_blob_storage/test.py::test_backup_restore_diff_container =========================== short test summary info ============================ FAILED test_backup_restore_new/test_cancel_backup.py::test_shutdown_cancel_backup PASSED test_cluster_all_replicas/test.py::test_cluster PASSED test_backup_restore_new/test.py::test_async PASSED test_cluster_all_replicas/test.py::test_error_on_unavailable_replica[one_shard_three_nodes] PASSED test_cluster_all_replicas/test.py::test_error_on_unavailable_replica[two_shards_three_nodes] PASSED test_cluster_all_replicas/test.py::test_global_in PASSED test_alter_codec/test.py::test_alter_codec_index PASSED test_backup_restore_new/test.py::test_async_backups_to_same_destination[http] PASSED test_alter_codec/test.py::test_alter_codec_pk PASSED test_backup_restore_new/test.py::test_async_backups_to_same_destination[native] PASSED test_backup_restore_new/test.py::test_backup_all[False] PASSED test_backup_restore_new/test.py::test_backup_all[True] PASSED test_backup_restore/test.py::test_attach_partition PASSED test_backup_restore_new/test.py::test_backup_database_except[False] PASSED test_backup_restore_new/test.py::test_backup_database_except[True] PASSED test_backup_restore_new/test.py::test_backup_not_found_or_already_exists PASSED test_backup_restore_new/test.py::test_backup_partition PASSED test_backup_restore_new/test.py::test_backup_table_under_another_name PASSED test_backup_restore_new/test.py::test_backupview PASSED test_backup_restore/test.py::test_replace_partition PASSED test_backup_restore_new/test.py::test_database PASSED test_backup_restore_new/test.py::test_dependencies PASSED test_alter_comment_on_cluster/test.py::test_comment PASSED test_backup_restore_new/test.py::test_empty_files_in_backup PASSED test_alter_on_mixed_type_cluster/test.py::test_alter_on_cluter_non_replicated PASSED test_backup_restore_new/test.py::test_file_engine PASSED test_backup_restore/test.py::test_restore PASSED test_backup_restore_new/test.py::test_increment_backup_without_changes PASSED test_alter_on_mixed_type_cluster/test.py::test_alter_replicated_on_cluster PASSED test_backup_restore_new/test.py::test_incremental_backup PASSED test_backup_restore_new/test.py::test_incremental_backup_after_renaming_table PASSED test_backup_restore_new/test.py::test_incremental_backup_append_table_def PASSED test_alter_settings_on_cluster/test.py::test_default_database_on_cluster PASSED test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_different_nodes PASSED test_backup_restore_new/test.py::test_incremental_backup_for_log_family PASSED test_backward_compatibility/test_functions.py::test_aggregate_states PASSED test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_same_node PASSED test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Atomic-MergeTree] PASSED test_backup_restore_new/test_cancel_backup.py::test_cancel_backup PASSED test_backup_restore_new/test.py::test_incremental_backup_overflow PASSED test_backup_restore_new/test.py::test_materialized_view PASSED test_backup_restore_new/test.py::test_materialized_view_select_1 PASSED test_backup_restore_new/test.py::test_materialized_view_with_target_table PASSED test_backup_restore_new/test.py::test_mutation PASSED test_backward_compatibility/test_functions.py::test_string_functions PASSED test_backup_restore_new/test.py::test_operation_id PASSED test_backup_restore_new/test.py::test_projection PASSED test_backup_restore_new/test.py::test_required_privileges PASSED test_backup_restore_new/test.py::test_restore_all_restores_temporary_tables PASSED test_backup_restore_new/test.py::test_restore_materialized_view_with_definer PASSED test_backup_restore_new/test.py::test_restore_partition PASSED test_backup_restore_new/test.py::test_restore_table[Log] PASSED test_backup_restore_new/test.py::test_restore_table[Memory] PASSED test_backup_restore_new/test.py::test_restore_table[MergeTree] PASSED test_backup_restore_new/test.py::test_restore_table[StripeLog] PASSED test_backup_restore_new/test.py::test_restore_table[TinyLog] PASSED test_backup_restore_azure_blob_storage/test.py::test_backup_restore PASSED test_backup_restore_new/test.py::test_restore_table_into_existing_table[Log] PASSED test_asynchronous_metric_jemalloc_profile_active/test.py::test_asynchronous_metric_jemalloc_profile_active PASSED test_backup_restore_new/test.py::test_restore_table_into_existing_table[Memory] PASSED test_backup_restore_new/test.py::test_restore_table_into_existing_table[MergeTree] PASSED test_backup_restore_new/test.py::test_restore_table_into_existing_table[StripeLog] PASSED test_backup_restore_new/test.py::test_restore_table_into_existing_table[TinyLog] PASSED test_backup_restore_new/test.py::test_restore_table_not_evaluate_table_defaults PASSED test_backup_restore_new/test.py::test_restore_table_under_another_name PASSED test_backup_restore_new/test.py::test_system_backups PASSED test_backup_restore_new/test.py::test_system_database PASSED test_backup_restore_new/test.py::test_system_functions PASSED test_backup_restore_new/test.py::test_system_table PASSED test_backup_restore_new/test.py::test_system_users PASSED test_backup_restore_new/test.py::test_system_users_async PASSED test_backup_restore_new/test.py::test_system_users_required_privileges PASSED test_analyzer_compatibility/test.py::test_two_new_versions PASSED test_async_connect_to_multiple_ips/test.py::test PASSED test_azure_blob_storage_zero_copy_replication/test.py::test_zero_copy_replication PASSED test_backup_restore_azure_blob_storage/test.py::test_backup_restore_correct_block_ids PASSED test_backup_restore_azure_blob_storage/test.py::test_backup_restore_diff_container PASSED test_backup_restore_azure_blob_storage/test.py::test_backup_restore_on_merge_tree PASSED test_backup_restore_azure_blob_storage/test.py::test_backup_restore_with_named_collection_azure_conf1 PASSED test_backup_restore_azure_blob_storage/test.py::test_backup_restore_with_named_collection_azure_conf2 PASSED test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Lazy-Log] PASSED test_backup_restore_new/test.py::test_tables_dependency PASSED test_backup_restore_new/test.py::test_tar_archive PASSED test_backup_restore_new/test.py::test_tar_archive_with_bad_compression_method PASSED test_backup_restore_new/test.py::test_tar_archive_with_password PASSED test_backup_restore_new/test.py::test_tar_bz2_archive PASSED test_backup_restore_new/test.py::test_tar_gz_archive PASSED test_backup_restore_new/test.py::test_tar_lzma_archive PASSED test_backup_restore_new/test.py::test_tar_xz_archive PASSED test_backup_restore_new/test.py::test_tar_zst_archive PASSED test_backup_restore_new/test.py::test_temporary_database PASSED test_backup_restore_new/test.py::test_temporary_table PASSED test_backup_restore_new/test.py::test_zip_archive PASSED test_backup_restore_new/test.py::test_zip_archive_with_bad_compression_method PASSED test_backup_restore_new/test.py::test_zip_archive_with_settings PASSED test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Memory-MergeTree] PASSED test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Ordinary-MergeTree] PASSED test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Replicated-ReplicatedMergeTree] PASSED test_backup_restore_on_cluster/test_concurrency.py::test_kill_mutation_during_backup PASSED test_backup_restore_on_cluster/test_concurrency.py::test_replicated_table =================== 1 failed, 99 passed in 442.55s (0:07:22) =================== Traceback (most recent call last): File "/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration/./runner", line 445, in subprocess.check_call(cmd, shell=True) File "/usr/lib/python3.10/subprocess.py", line 369, in check_call raise CalledProcessError(retcode, cmd) subprocess.CalledProcessError: Command 'docker run --rm --name clickhouse_integration_tests_63quwt --privileged --dns-search='.' --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-odbc-bridge:/clickhouse-odbc-bridge --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-library-bridge:/clickhouse-library-bridge --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=2cffe1eae894 -e DOCKER_BASE_TAG=b74d853ebe76 -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=caad4729259e -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS="--dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 test_alter_codec/test.py::test_alter_codec_index test_alter_codec/test.py::test_alter_codec_pk test_alter_comment_on_cluster/test.py::test_comment test_alter_on_mixed_type_cluster/test.py::test_alter_on_cluter_non_replicated test_alter_on_mixed_type_cluster/test.py::test_alter_replicated_on_cluster test_alter_settings_on_cluster/test.py::test_default_database_on_cluster test_analyzer_compatibility/test.py::test_two_new_versions test_async_connect_to_multiple_ips/test.py::test test_asynchronous_metric_jemalloc_profile_active/test.py::test_asynchronous_metric_jemalloc_profile_active test_azure_blob_storage_zero_copy_replication/test.py::test_zero_copy_replication test_backup_restore/test.py::test_attach_partition test_backup_restore/test.py::test_replace_partition test_backup_restore/test.py::test_restore test_backup_restore_azure_blob_storage/test.py::test_backup_restore test_backup_restore_azure_blob_storage/test.py::test_backup_restore_correct_block_ids test_backup_restore_azure_blob_storage/test.py::test_backup_restore_diff_container test_backup_restore_azure_blob_storage/test.py::test_backup_restore_on_merge_tree test_backup_restore_azure_blob_storage/test.py::test_backup_restore_with_named_collection_azure_conf1 test_backup_restore_azure_blob_storage/test.py::test_backup_restore_with_named_collection_azure_conf2 test_backup_restore_new/test.py::test_async 'test_backup_restore_new/test.py::test_async_backups_to_same_destination[http]' 'test_backup_restore_new/test.py::test_async_backups_to_same_destination[native]' 'test_backup_restore_new/test.py::test_backup_all[False]' 'test_backup_restore_new/test.py::test_backup_all[True]' 'test_backup_restore_new/test.py::test_backup_database_except[False]' 'test_backup_restore_new/test.py::test_backup_database_except[True]' test_backup_restore_new/test.py::test_backup_not_found_or_already_exists test_backup_restore_new/test.py::test_backup_partition test_backup_restore_new/test.py::test_backup_table_under_another_name test_backup_restore_new/test.py::test_backupview test_backup_restore_new/test.py::test_database test_backup_restore_new/test.py::test_dependencies test_backup_restore_new/test.py::test_empty_files_in_backup test_backup_restore_new/test.py::test_file_engine test_backup_restore_new/test.py::test_increment_backup_without_changes test_backup_restore_new/test.py::test_incremental_backup test_backup_restore_new/test.py::test_incremental_backup_after_renaming_table test_backup_restore_new/test.py::test_incremental_backup_append_table_def test_backup_restore_new/test.py::test_incremental_backup_for_log_family test_backup_restore_new/test.py::test_incremental_backup_overflow test_backup_restore_new/test.py::test_materialized_view test_backup_restore_new/test.py::test_materialized_view_select_1 test_backup_restore_new/test.py::test_materialized_view_with_target_table test_backup_restore_new/test.py::test_mutation test_backup_restore_new/test.py::test_operation_id test_backup_restore_new/test.py::test_projection test_backup_restore_new/test.py::test_required_privileges test_backup_restore_new/test.py::test_restore_all_restores_temporary_tables test_backup_restore_new/test.py::test_restore_materialized_view_with_definer test_backup_restore_new/test.py::test_restore_partition 'test_backup_restore_new/test.py::test_restore_table[Log]' 'test_backup_restore_new/test.py::test_restore_table[Memory]' 'test_backup_restore_new/test.py::test_restore_table[MergeTree]' 'test_backup_restore_new/test.py::test_restore_table[StripeLog]' 'test_backup_restore_new/test.py::test_restore_table[TinyLog]' 'test_backup_restore_new/test.py::test_restore_table_into_existing_table[Log]' 'test_backup_restore_new/test.py::test_restore_table_into_existing_table[Memory]' 'test_backup_restore_new/test.py::test_restore_table_into_existing_table[MergeTree]' 'test_backup_restore_new/test.py::test_restore_table_into_existing_table[StripeLog]' 'test_backup_restore_new/test.py::test_restore_table_into_existing_table[TinyLog]' test_backup_restore_new/test.py::test_restore_table_not_evaluate_table_defaults test_backup_restore_new/test.py::test_restore_table_under_another_name test_backup_restore_new/test.py::test_system_backups test_backup_restore_new/test.py::test_system_database test_backup_restore_new/test.py::test_system_functions test_backup_restore_new/test.py::test_system_table test_backup_restore_new/test.py::test_system_users test_backup_restore_new/test.py::test_system_users_async test_backup_restore_new/test.py::test_system_users_required_privileges test_backup_restore_new/test.py::test_tables_dependency test_backup_restore_new/test.py::test_tar_archive test_backup_restore_new/test.py::test_tar_archive_with_bad_compression_method test_backup_restore_new/test.py::test_tar_archive_with_password test_backup_restore_new/test.py::test_tar_bz2_archive test_backup_restore_new/test.py::test_tar_gz_archive test_backup_restore_new/test.py::test_tar_lzma_archive test_backup_restore_new/test.py::test_tar_xz_archive test_backup_restore_new/test.py::test_tar_zst_archive test_backup_restore_new/test.py::test_temporary_database test_backup_restore_new/test.py::test_temporary_table test_backup_restore_new/test.py::test_zip_archive test_backup_restore_new/test.py::test_zip_archive_with_bad_compression_method test_backup_restore_new/test.py::test_zip_archive_with_settings test_backup_restore_new/test_cancel_backup.py::test_cancel_backup test_backup_restore_new/test_cancel_backup.py::test_shutdown_cancel_backup test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_different_nodes test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_same_node 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Atomic-MergeTree]' 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Lazy-Log]' 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Memory-MergeTree]' 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Ordinary-MergeTree]' 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Replicated-ReplicatedMergeTree]' test_backup_restore_on_cluster/test_concurrency.py::test_kill_mutation_during_backup test_backup_restore_on_cluster/test_concurrency.py::test_replicated_table test_backward_compatibility/test_functions.py::test_aggregate_states test_backward_compatibility/test_functions.py::test_string_functions test_cluster_all_replicas/test.py::test_cluster 'test_cluster_all_replicas/test.py::test_error_on_unavailable_replica[one_shard_three_nodes]' 'test_cluster_all_replicas/test.py::test_error_on_unavailable_replica[two_shards_three_nodes]' test_cluster_all_replicas/test.py::test_global_in -vvv" altinityinfra/integration-tests-runner:cf95077f4609 ' returned non-zero exit status 1.